04-24 12:09:58 D/ModuleListener: ModuleListener.testStarted(com.google.android.assistant.v4.tvts.TvtsAssistant4Test#testDistanceToTheMoon) on SKBFXYZO0C1V
04-24 12:09:58 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:09:58 D/DeviceHostUtils: apiLevel: 31
04-24 12:09:58 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:09:58 D/DeviceHostUtils: apiLevel: 31
04-24 12:09:58 I/TvtsBaseAssistantTest: Running setup...
04-24 12:09:58 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
04-24 12:09:58 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
04-24 12:09:59 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:09:59 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
04-24 12:09:59 I/DeviceStateMonitor: Waiting 359932 ms for device SKBFXYZO0C1V package manager
04-24 12:09:59 I/NativeDeviceStateMonitor: Waiting 359764 ms for device SKBFXYZO0C1V external store
04-24 12:10:00 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:10:00 D/NativeDevice: Using property ro.build.version.codename=REL from cache.
04-24 12:10:00 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:10:00 D/WifiUtil.apk5804621323663574807.apk: Uploading WifiUtil.apk5804621323663574807.apk onto device 'SKBFXYZO0C1V'
04-24 12:10:00 D/Device: Uploading file onto device 'SKBFXYZO0C1V'
04-24 12:10:00 D/RunUtil: Running command [aapt, dump, badging, /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/WifiUtil.apk5804621323663574807.apk] with timeout: 1m 0s
04-24 12:10:00 D/RunUtil: Running command [aapt, dump, xmltree, /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/WifiUtil.apk5804621323663574807.apk, AndroidManifest.xml] with timeout: 1m 0s
04-24 12:10:00 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, appops, write-settings] with timeout: 2m 0s
04-24 12:10:03 D/AppRunnerUtils: foregroundActivitySet(): [com.google.android.katniss/com.google.android.apps.tvsearch.setup.AssistantSetupActivity]
04-24 12:10:03 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.google.android.apps.tvsearch.setup.AssistantSetupActivity.
04-24 12:10:03 D/AssistantTestUtils: Assistant successfully launched: true
04-24 12:10:04 D/TvtsBaseAssistantTest: Checking required services running...
04-24 12:10:04 D/RunUtil: Running command null without timeout.
04-24 12:10:04 D/AppRunnerUtils: Checking service: com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
04-24 12:10:04 D/AppRunnerUtils: Running the following command: dumpsys activity service com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
04-24 12:10:04 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, activity, service, com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService] with timeout: 2m 0s
04-24 12:10:04 I/AppRunnerUtils: Service PID = 4573
04-24 12:10:04 D/RunUtil: Running command null without timeout.
04-24 12:10:04 D/AppRunnerUtils: Checking service: com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
04-24 12:10:04 D/AppRunnerUtils: Running the following command: dumpsys activity service com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
04-24 12:10:04 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, activity, service, com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService] with timeout: 2m 0s
04-24 12:10:04 I/AppRunnerUtils: Service PID = 4573
04-24 12:10:04 D/TvtsBaseAssistantTest: Checking required processes running...
04-24 12:10:04 D/TvtsBaseAssistantTest: Enabling additional options...
04-24 12:10:04 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 12:10:05 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.katniss
04-24 12:10:05 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.katniss] with timeout: 2m 0s
04-24 12:10:05 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:10:05 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:10:06 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:10:06 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:10:06 D/RunUtil: Running command null without timeout.
04-24 12:10:06 D/AppRunnerUtils: Checking service: com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
04-24 12:10:06 D/AppRunnerUtils: Running the following command: dumpsys activity service com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
04-24 12:10:06 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, activity, service, com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService] with timeout: 2m 0s
04-24 12:10:06 I/AppRunnerUtils: Service PID = 9593
04-24 12:10:06 D/RunUtil: Running command null without timeout.
04-24 12:10:06 D/AppRunnerUtils: Checking service: com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
04-24 12:10:06 D/AppRunnerUtils: Running the following command: dumpsys activity service com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
04-24 12:10:06 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, activity, service, com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService] with timeout: 2m 0s
04-24 12:10:06 I/AppRunnerUtils: Service PID = 9593
04-24 12:10:06 I/AssistantTestUtils: Waiting for assistant to be ready...
04-24 12:10:06 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
04-24 12:10:06 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
04-24 12:10:06 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:10:06 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 12:10:07 I/DeviceStateMonitor: Waiting 359816 ms for device SKBFXYZO0C1V package manager
04-24 12:10:07 I/NativeDeviceStateMonitor: Waiting 359580 ms for device SKBFXYZO0C1V external store
04-24 12:10:10 D/AppRunnerUtils: foregroundActivitySet(): [com.google.android.katniss/com.google.android.apps.tvsearch.setup.AssistantSetupActivity]
04-24 12:10:10 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.google.android.apps.tvsearch.setup.AssistantSetupActivity.
04-24 12:10:10 D/AssistantTestUtils: Assistant successfully launched: true
04-24 12:10:11 D/RunUtil: Running command [logcat -d | grep -E 'AssistantWrapper(Impl)?: Assistant is now running.'] without timeout.
04-24 12:10:11 I/AssistantTestUtils: Assistant ready: true
04-24 12:10:11 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
04-24 12:10:11 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
04-24 12:10:12 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:10:12 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 12:10:12 I/DeviceStateMonitor: Waiting 359923 ms for device SKBFXYZO0C1V package manager
04-24 12:10:12 I/NativeDeviceStateMonitor: Waiting 359856 ms for device SKBFXYZO0C1V external store
04-24 12:10:14 D/AppRunnerUtils: foregroundActivitySet(): [com.google.android.katniss/com.google.android.apps.tvsearch.setup.AssistantSetupActivity]
04-24 12:10:14 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.google.android.apps.tvsearch.setup.AssistantSetupActivity.
04-24 12:10:14 D/AssistantTestUtils: Assistant successfully launched: true
04-24 12:10:15 D/RunUtil: Running command null without timeout.
04-24 12:10:15 I/AssistantTestUtils: Checking if file pattern is present: /storage/emulated/0/Download/katniss-primes*
04-24 12:10:15 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, ls, -t, -d, /storage/emulated/0/Download/katniss-primes*] with timeout: 2m 0s
04-24 12:10:15 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, ls, -t, -d, /storage/emulated/0/Download/katniss-primes*] with timeout: 2m 0s
04-24 12:10:15 D/AssistantTestUtils: Session-based metrics File: /storage/emulated/0/Download/katniss-primes-2024-04-23T20_10_12.086.txt
04-24 12:10:15 D/NativeDevice: Using 'ls' to check doesFileExist(/storage/emulated/0/Download/katniss-primes-2024-04-23T20_10_12.086.txt)
04-24 12:10:15 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:10:15 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T20_10_12.086_13409686632202349103.txt] without timeout.
04-24 12:10:15 D/TvtsBaseAssistantTest: Metrics location: /storage/emulated/0/Download/katniss-primes-2024-04-23T20_10_12.086.txt
04-24 12:10:15 D/TvtsBaseAssistantTest: Option enabling successful!
04-24 12:10:15 I/KeyCodeUtils: Sending keyevent KEYCODE_BACK - intValue: 4
04-24 12:10:16 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:10:16 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:10:17 D/TvtsBaseAssistantTest: Running connectivity check...
04-24 12:10:17 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:10:17 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
04-24 12:10:17 I/DeviceStateMonitor: Waiting 359928 ms for device SKBFXYZO0C1V package manager
04-24 12:10:17 I/NativeDeviceStateMonitor: Waiting 359841 ms for device SKBFXYZO0C1V external store
04-24 12:10:19 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:10:19 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
04-24 12:10:19 I/DeviceStateMonitor: Waiting 359933 ms for device SKBFXYZO0C1V package manager
04-24 12:10:19 I/NativeDeviceStateMonitor: Waiting 359841 ms for device SKBFXYZO0C1V external store
04-24 12:10:21 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:10:21 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
04-24 12:10:21 I/DeviceStateMonitor: Waiting 359933 ms for device SKBFXYZO0C1V package manager
04-24 12:10:21 I/NativeDeviceStateMonitor: Waiting 359865 ms for device SKBFXYZO0C1V external store
04-24 12:10:23 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:10:23 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
04-24 12:10:23 I/DeviceStateMonitor: Waiting 359921 ms for device SKBFXYZO0C1V package manager
04-24 12:10:24 I/NativeDeviceStateMonitor: Waiting 359828 ms for device SKBFXYZO0C1V external store
04-24 12:10:25 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:10:25 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
04-24 12:10:26 I/DeviceStateMonitor: Waiting 359916 ms for device SKBFXYZO0C1V package manager
04-24 12:10:26 I/NativeDeviceStateMonitor: Waiting 359829 ms for device SKBFXYZO0C1V external store
04-24 12:10:28 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:10:28 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 12:10:28 I/DeviceStateMonitor: Waiting 359928 ms for device SKBFXYZO0C1V package manager
04-24 12:10:28 I/NativeDeviceStateMonitor: Waiting 359861 ms for device SKBFXYZO0C1V external store
04-24 12:10:30 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:10:30 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 12:10:30 I/DeviceStateMonitor: Waiting 359963 ms for device SKBFXYZO0C1V package manager
04-24 12:10:30 I/NativeDeviceStateMonitor: Waiting 359900 ms for device SKBFXYZO0C1V external store
04-24 12:10:32 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
04-24 12:10:32 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
04-24 12:10:32 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:10:32 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 12:10:33 I/DeviceStateMonitor: Waiting 359888 ms for device SKBFXYZO0C1V package manager
04-24 12:10:33 I/NativeDeviceStateMonitor: Waiting 359710 ms for device SKBFXYZO0C1V external store
04-24 12:10:35 D/AppRunnerUtils: foregroundActivitySet(): [com.google.android.katniss/com.google.android.apps.tvsearch.setup.AssistantSetupActivity]
04-24 12:10:36 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.google.android.apps.tvsearch.setup.AssistantSetupActivity.
04-24 12:10:36 D/AssistantTestUtils: Assistant successfully launched: true
04-24 12:10:36 I/KeyCodeUtils: Sending keyevent KEYCODE_BACK - intValue: 4
04-24 12:10:36 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:10:37 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:10:38 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
04-24 12:10:38 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
04-24 12:10:38 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:10:38 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
04-24 12:10:38 I/DeviceStateMonitor: Waiting 359931 ms for device SKBFXYZO0C1V package manager
04-24 12:10:38 I/NativeDeviceStateMonitor: Waiting 359807 ms for device SKBFXYZO0C1V external store
04-24 12:10:40 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, window, windows, --proto] with timeout: 2m 0s
04-24 12:10:40 D/AppRunnerUtils: com.google.android.katniss/com.google.android.apps.tvsearch.setup.AssistantSetupActivity
04-24 12:10:40 D/AssistantTestUtils: Successfully triggered assistant setup.
04-24 12:10:40 D/TvtsBaseAssistantTest: OOBE skipping required: true
04-24 12:10:40 I/KeyCodeUtils: Sending keyevent KEYCODE_BACK - intValue: 4
04-24 12:10:41 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:10:42 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:10:42 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
04-24 12:10:42 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
04-24 12:10:43 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:10:43 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
04-24 12:10:43 I/DeviceStateMonitor: Waiting 359932 ms for device SKBFXYZO0C1V package manager
04-24 12:10:43 I/NativeDeviceStateMonitor: Waiting 359809 ms for device SKBFXYZO0C1V external store
04-24 12:10:45 D/AppRunnerUtils: foregroundActivitySet(): [com.google.android.katniss/com.google.android.apps.tvsearch.setup.AssistantSetupActivity]
04-24 12:10:46 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.google.android.apps.tvsearch.setup.AssistantSetupActivity.
04-24 12:10:46 D/AssistantTestUtils: Assistant successfully launched: true
04-24 12:10:46 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
04-24 12:10:46 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
04-24 12:10:47 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:10:47 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
04-24 12:10:47 I/DeviceStateMonitor: Waiting 359932 ms for device SKBFXYZO0C1V package manager
04-24 12:10:47 I/NativeDeviceStateMonitor: Waiting 359864 ms for device SKBFXYZO0C1V external store
04-24 12:10:49 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, window, windows, --proto] with timeout: 2m 0s
04-24 12:10:49 D/AppRunnerUtils: com.google.android.katniss/com.google.android.apps.tvsearch.setup.AssistantSetupActivity
04-24 12:10:49 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:10:49 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 12:10:49 I/DeviceStateMonitor: Waiting 359958 ms for device SKBFXYZO0C1V package manager
04-24 12:10:49 I/NativeDeviceStateMonitor: Waiting 359891 ms for device SKBFXYZO0C1V external store
04-24 12:10:51 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, window, windows, --proto] with timeout: 2m 0s
04-24 12:10:51 D/AppRunnerUtils: com.google.android.katniss/com.google.android.apps.tvsearch.setup.AssistantSetupActivity
04-24 12:10:51 D/AssistantTestUtils: Accepting all in OOBE...
04-24 12:10:51 I/KeyCodeUtils: Sending keyevent KEYCODE_ENTER - intValue: 66
04-24 12:10:52 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:10:52 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 12:10:52 I/DeviceStateMonitor: Waiting 359958 ms for device SKBFXYZO0C1V package manager
04-24 12:10:52 I/NativeDeviceStateMonitor: Waiting 359866 ms for device SKBFXYZO0C1V external store
04-24 12:10:54 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, window, windows, --proto] with timeout: 2m 0s
04-24 12:10:54 D/AppRunnerUtils: com.google.android.katniss/com.google.android.apps.tvsearch.setup.AssistantDataSharingConsentActivity
04-24 12:10:54 I/KeyCodeUtils: Sending keyevent KEYCODE_ENTER - intValue: 66
04-24 12:10:55 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:10:55 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
04-24 12:10:55 I/DeviceStateMonitor: Waiting 359958 ms for device SKBFXYZO0C1V package manager
04-24 12:10:55 I/NativeDeviceStateMonitor: Waiting 359870 ms for device SKBFXYZO0C1V external store
04-24 12:10:57 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, window, windows, --proto] with timeout: 2m 0s
04-24 12:10:57 D/AppRunnerUtils: com.google.android.katniss/com.google.android.apps.tvsearch.setup.AssistantSetupActivity
04-24 12:10:57 I/KeyCodeUtils: Sending keyevent KEYCODE_ENTER - intValue: 66
04-24 12:10:57 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:10:57 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 12:10:57 I/DeviceStateMonitor: Waiting 359938 ms for device SKBFXYZO0C1V package manager
04-24 12:10:57 I/NativeDeviceStateMonitor: Waiting 359876 ms for device SKBFXYZO0C1V external store
04-24 12:10:59 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, window, windows, --proto] with timeout: 2m 0s
04-24 12:10:59 D/AppRunnerUtils: com.google.android.katniss/com.google.android.apps.tvsearch.setup.AssistantSetupActivity
04-24 12:10:59 I/KeyCodeUtils: Sending keyevent KEYCODE_ENTER - intValue: 66
04-24 12:11:00 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:11:00 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
04-24 12:11:00 I/DeviceStateMonitor: Waiting 359958 ms for device SKBFXYZO0C1V package manager
04-24 12:11:00 I/NativeDeviceStateMonitor: Waiting 359889 ms for device SKBFXYZO0C1V external store
04-24 12:11:02 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, window, windows, --proto] with timeout: 2m 0s
04-24 12:11:02 D/AppRunnerUtils: com.google.android.katniss/com.google.android.apps.tvsearch.setup.AssistantSetupActivity
04-24 12:11:02 I/KeyCodeUtils: Sending keyevent KEYCODE_ENTER - intValue: 66
04-24 12:11:03 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:11:03 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
04-24 12:11:03 I/DeviceStateMonitor: Waiting 359927 ms for device SKBFXYZO0C1V package manager
04-24 12:11:03 I/NativeDeviceStateMonitor: Waiting 359833 ms for device SKBFXYZO0C1V external store
04-24 12:11:05 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, window, windows, --proto] with timeout: 2m 0s
04-24 12:11:05 D/AppRunnerUtils: 
04-24 12:11:05 D/RunUtil: Running command null without timeout.
04-24 12:11:05 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:11:05 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:11:05 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:11:05 D/RunUtil: Running command null without timeout.
04-24 12:11:05 D/AppRunnerUtils: foregroundActivitySet(): [com.google.android.youtube.tv/com.google.android.apps.youtube.tv.activity.ShellActivity, com.google.android.katniss/com.google.android.apps.tvsearch.setup.AssistantSetupActivity, com.google.android.youtube.tv/com.google.android.apps.youtube.tv.activity.StandalonePlayerActivity]
04-24 12:11:05 I/KeyCodeUtils: Sending keyevent KEYCODE_HOME - intValue: 3
04-24 12:11:06 D/AppRunnerUtils: [com.google.android.youtube.tv/com.google.android.apps.youtube.tv.activity.ShellActivity, com.google.android.katniss/com.google.android.apps.tvsearch.setup.AssistantSetupActivity, com.google.android.youtube.tv/com.google.android.apps.youtube.tv.activity.StandalonePlayerActivity]
04-24 12:11:06 D/RunUtil: operation failed, waiting for 500 ms
04-24 12:11:06 D/RunUtil: Running command null without timeout.
04-24 12:11:06 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:11:06 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:11:06 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
04-24 12:11:06 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
04-24 12:11:07 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:11:07 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
04-24 12:11:07 I/DeviceStateMonitor: Waiting 359933 ms for device SKBFXYZO0C1V package manager
04-24 12:11:07 I/NativeDeviceStateMonitor: Waiting 359835 ms for device SKBFXYZO0C1V external store
04-24 12:11:09 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, window, windows, --proto] with timeout: 2m 0s
04-24 12:11:09 D/AppRunnerUtils: com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity
04-24 12:11:09 D/AssistantTestUtils: AssistantSearchActivity: SearchResultActivity
04-24 12:11:09 D/AssistantTestUtils: Successfully triggered assistant search.
04-24 12:11:09 I/KeyCodeUtils: Sending keyevent KEYCODE_BACK - intValue: 4
04-24 12:11:10 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:11:11 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:11:11 D/RunUtil: Running command null without timeout.
04-24 12:11:11 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:11:11 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:11:11 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:11:11 D/RunUtil: Running command null without timeout.
04-24 12:11:11 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:11:12 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:11:12 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
04-24 12:11:12 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
04-24 12:11:12 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:11:12 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
04-24 12:11:12 I/DeviceStateMonitor: Waiting 359933 ms for device SKBFXYZO0C1V package manager
04-24 12:11:12 I/NativeDeviceStateMonitor: Waiting 359866 ms for device SKBFXYZO0C1V external store
04-24 12:11:14 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, window, windows, --proto] with timeout: 2m 0s
04-24 12:11:15 D/AppRunnerUtils: com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity
04-24 12:11:15 D/AssistantTestUtils: AssistantSearchActivity: SearchResultActivity
04-24 12:11:15 D/AssistantTestUtils: Successfully triggered assistant search.
04-24 12:11:15 I/TvtsBaseAssistantTest: Test: MoonTest
04-24 12:11:15 I/MeasurementPrinter: search-to-query	Measurement Status	query-to-result	Measurement Status	query-to-result-no-server-latency	Measurement Status
04-24 12:11:15 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:11:15 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 12:11:15 I/DeviceStateMonitor: Waiting 359939 ms for device SKBFXYZO0C1V package manager
04-24 12:11:15 I/NativeDeviceStateMonitor: Waiting 359877 ms for device SKBFXYZO0C1V external store
04-24 12:11:17 D/RunUtil: Running command null without timeout.
04-24 12:11:17 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:11:17 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:11:17 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:11:17 D/RunUtil: Running command null without timeout.
04-24 12:11:17 D/AppRunnerUtils: foregroundActivitySet(): [com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity]
04-24 12:11:17 I/KeyCodeUtils: Sending keyevent KEYCODE_HOME - intValue: 3
04-24 12:11:17 D/AppRunnerUtils: [com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity]
04-24 12:11:17 D/RunUtil: operation failed, waiting for 500 ms
04-24 12:11:17 D/RunUtil: Running command null without timeout.
04-24 12:11:17 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:11:18 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:11:18 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:11:18 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:11:18 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 12:11:18 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:11:18 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T20_10_12.086_2206026060456040787.txt] without timeout.
04-24 12:11:19 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 12:11:19 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 12:11:19 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 12:11:19 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.MoonTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 12:12:26 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:12:27 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 12:12:27 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 12:12:27 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 407.000000
04-24 12:12:27 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 10.000000
04-24 12:12:27 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
04-24 12:12:27 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 40.000000
04-24 12:12:27 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 121.000000
04-24 12:12:27 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 202.000000
04-24 12:12:27 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 33.000000
04-24 12:12:27 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 6.000000
04-24 12:12:27 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 103.000000
04-24 12:12:27 D/ProtoMeasurementBase: UI_DISPLAYED: size = 1, sum: 0.000000
04-24 12:12:27 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 5.000000
04-24 12:12:27 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35516.000000
04-24 12:12:27 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 71.000000
04-24 12:12:27 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 142.000000
04-24 12:12:27 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 12:12:27 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:12:27 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 12:12:27 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 12:12:27 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 407.000000
04-24 12:12:27 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 10.000000
04-24 12:12:27 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
04-24 12:12:27 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 40.000000
04-24 12:12:27 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 121.000000
04-24 12:12:27 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 202.000000
04-24 12:12:27 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 33.000000
04-24 12:12:27 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 6.000000
04-24 12:12:27 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 103.000000
04-24 12:12:27 D/ProtoMeasurementBase: UI_DISPLAYED: size = 1, sum: 0.000000
04-24 12:12:27 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 5.000000
04-24 12:12:27 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35516.000000
04-24 12:12:27 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 71.000000
04-24 12:12:27 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 142.000000
04-24 12:12:27 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 12:12:27 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 12:12:27 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:12:27 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 12:12:27 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 12:12:27 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 407.000000
04-24 12:12:27 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 10.000000
04-24 12:12:27 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
04-24 12:12:27 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 40.000000
04-24 12:12:27 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 121.000000
04-24 12:12:27 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 202.000000
04-24 12:12:27 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 33.000000
04-24 12:12:27 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 6.000000
04-24 12:12:27 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 103.000000
04-24 12:12:27 D/ProtoMeasurementBase: UI_DISPLAYED: size = 1, sum: 0.000000
04-24 12:12:27 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 5.000000
04-24 12:12:27 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35516.000000
04-24 12:12:27 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 71.000000
04-24 12:12:27 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 142.000000
04-24 12:12:27 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_card
04-24 12:12:27 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 12:12:27 I/MeasurementPrinter:           142.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 12:12:27 E/TvtsBaseAssistantTest: Run 1/20 encountered exception. See logs for details
04-24 12:12:27 E/TvtsBaseAssistantTest: MoonTest failed: 
com.google.android.assistant.tvts.MoonTest:
Error in testMoonResponse(com.google.android.assistant.tvts.MoonTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)


Time: 65.445
There was 1 failure:
1) testMoonResponse(com.google.android.assistant.tvts.MoonTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 12:12:27 D/RunUtil: Running command null without timeout.
04-24 12:12:27 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:12:28 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:12:28 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:12:28 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:12:28 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:12:28 D/RunUtil: Running command null without timeout.
04-24 12:12:28 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:12:28 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:12:28 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:12:28 D/RunUtil: Running command null without timeout.
04-24 12:12:29 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:12:29 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:12:29 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:12:29 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
04-24 12:12:29 I/DeviceStateMonitor: Waiting 359938 ms for device SKBFXYZO0C1V package manager
04-24 12:12:29 I/NativeDeviceStateMonitor: Waiting 359850 ms for device SKBFXYZO0C1V external store
04-24 12:12:31 D/RunUtil: Running command null without timeout.
04-24 12:12:31 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:12:31 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:12:31 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:12:31 D/RunUtil: Running command null without timeout.
04-24 12:12:31 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:12:31 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:12:31 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:12:32 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:12:32 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 12:12:32 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:12:32 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T20_10_12.086_16252220408921533327.txt] without timeout.
04-24 12:12:32 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 12:12:32 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 12:12:32 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 12:12:32 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.MoonTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 12:13:40 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:13:40 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 12:13:40 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 8.000000
04-24 12:13:40 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 581.000000
04-24 12:13:40 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
04-24 12:13:40 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
04-24 12:13:40 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 28.000000
04-24 12:13:40 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 76.000000
04-24 12:13:40 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 170.000000
04-24 12:13:40 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 19.000000
04-24 12:13:40 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 8.000000
04-24 12:13:40 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 233.000000
04-24 12:13:40 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 7.000000
04-24 12:13:40 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35462.000000
04-24 12:13:40 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 47.000000
04-24 12:13:40 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 101.000000
04-24 12:13:40 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 12:13:40 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:13:40 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 12:13:40 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 8.000000
04-24 12:13:40 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 581.000000
04-24 12:13:40 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
04-24 12:13:40 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
04-24 12:13:40 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 28.000000
04-24 12:13:40 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 76.000000
04-24 12:13:40 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 170.000000
04-24 12:13:40 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 19.000000
04-24 12:13:40 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 8.000000
04-24 12:13:40 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 233.000000
04-24 12:13:40 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 7.000000
04-24 12:13:40 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35462.000000
04-24 12:13:40 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 47.000000
04-24 12:13:40 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 101.000000
04-24 12:13:40 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 12:13:40 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 12:13:40 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:13:40 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 12:13:40 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 8.000000
04-24 12:13:40 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 581.000000
04-24 12:13:40 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
04-24 12:13:40 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
04-24 12:13:40 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 28.000000
04-24 12:13:40 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 76.000000
04-24 12:13:40 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 170.000000
04-24 12:13:40 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 19.000000
04-24 12:13:40 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 8.000000
04-24 12:13:40 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 233.000000
04-24 12:13:40 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 7.000000
04-24 12:13:40 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35462.000000
04-24 12:13:40 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 47.000000
04-24 12:13:40 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 101.000000
04-24 12:13:40 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_card
04-24 12:13:40 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 12:13:40 I/MeasurementPrinter:           101.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 12:13:40 E/TvtsBaseAssistantTest: Run 2/20 encountered exception. See logs for details
04-24 12:13:40 E/TvtsBaseAssistantTest: MoonTest failed: 
com.google.android.assistant.tvts.MoonTest:
Error in testMoonResponse(com.google.android.assistant.tvts.MoonTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)


Time: 65.272
There was 1 failure:
1) testMoonResponse(com.google.android.assistant.tvts.MoonTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 12:13:40 D/RunUtil: Running command null without timeout.
04-24 12:13:40 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:13:41 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:13:41 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:13:41 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:13:42 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:13:42 D/RunUtil: Running command null without timeout.
04-24 12:13:42 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:13:42 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:13:42 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:13:42 D/RunUtil: Running command null without timeout.
04-24 12:13:42 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:13:42 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:13:42 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:13:42 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 12:13:42 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
04-24 12:13:42 I/NativeDeviceStateMonitor: Waiting 359902 ms for device SKBFXYZO0C1V external store
04-24 12:13:44 D/RunUtil: Running command null without timeout.
04-24 12:13:44 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:13:44 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:13:44 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:13:44 D/RunUtil: Running command null without timeout.
04-24 12:13:44 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:13:44 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:13:44 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:13:45 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:13:45 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 12:13:45 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:13:45 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T20_10_12.086_1359637785318738343.txt] without timeout.
04-24 12:13:45 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 12:13:45 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 12:13:45 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 12:13:45 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.MoonTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 12:14:53 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:14:53 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 12:14:53 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 9.000000
04-24 12:14:53 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 408.000000
04-24 12:14:53 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 25.000000
04-24 12:14:53 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 176.000000
04-24 12:14:53 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 122.000000
04-24 12:14:53 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 8.000000
04-24 12:14:53 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35526.000000
04-24 12:14:53 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 108.000000
04-24 12:14:53 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 12:14:53 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:14:53 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 12:14:53 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 9.000000
04-24 12:14:53 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 408.000000
04-24 12:14:53 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 25.000000
04-24 12:14:53 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 176.000000
04-24 12:14:53 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 122.000000
04-24 12:14:53 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 8.000000
04-24 12:14:53 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35526.000000
04-24 12:14:53 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 108.000000
04-24 12:14:53 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 12:14:53 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 12:14:53 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:14:53 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 12:14:53 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 9.000000
04-24 12:14:53 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 408.000000
04-24 12:14:53 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 25.000000
04-24 12:14:53 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 176.000000
04-24 12:14:53 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 122.000000
04-24 12:14:53 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 8.000000
04-24 12:14:53 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35526.000000
04-24 12:14:53 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 108.000000
04-24 12:14:53 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_card
04-24 12:14:53 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 12:14:53 I/MeasurementPrinter:           108.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 12:14:53 E/TvtsBaseAssistantTest: Run 3/20 encountered exception. See logs for details
04-24 12:14:53 E/TvtsBaseAssistantTest: MoonTest failed: 
com.google.android.assistant.tvts.MoonTest:
Error in testMoonResponse(com.google.android.assistant.tvts.MoonTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)


Time: 65.392
There was 1 failure:
1) testMoonResponse(com.google.android.assistant.tvts.MoonTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 12:14:53 D/RunUtil: Running command null without timeout.
04-24 12:14:54 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:14:54 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:14:54 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:14:54 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:14:55 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:14:55 D/RunUtil: Running command null without timeout.
04-24 12:14:55 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:14:55 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:14:55 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:14:55 D/RunUtil: Running command null without timeout.
04-24 12:14:55 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:14:55 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:14:55 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:14:55 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 12:14:55 I/DeviceStateMonitor: Waiting 359963 ms for device SKBFXYZO0C1V package manager
04-24 12:14:55 I/NativeDeviceStateMonitor: Waiting 359901 ms for device SKBFXYZO0C1V external store
04-24 12:14:57 D/RunUtil: Running command null without timeout.
04-24 12:14:57 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:14:57 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:14:57 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:14:57 D/RunUtil: Running command null without timeout.
04-24 12:14:57 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:14:57 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:14:57 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:14:58 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:14:58 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 12:14:58 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:14:58 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T20_10_12.086_554877722996919304.txt] without timeout.
04-24 12:14:59 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 12:14:59 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 12:14:59 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 12:14:59 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.MoonTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 12:16:06 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:16:06 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 12:16:06 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 4.000000
04-24 12:16:06 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 444.000000
04-24 12:16:06 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 12.000000
04-24 12:16:06 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 226.000000
04-24 12:16:06 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 68.000000
04-24 12:16:06 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 7.000000
04-24 12:16:06 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35470.000000
04-24 12:16:06 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 100.000000
04-24 12:16:06 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 12:16:06 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:16:07 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 12:16:07 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 4.000000
04-24 12:16:07 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 444.000000
04-24 12:16:07 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 12.000000
04-24 12:16:07 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 226.000000
04-24 12:16:07 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 68.000000
04-24 12:16:07 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 7.000000
04-24 12:16:07 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35470.000000
04-24 12:16:07 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 100.000000
04-24 12:16:07 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 12:16:07 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 12:16:07 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:16:07 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 12:16:07 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 4.000000
04-24 12:16:07 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 444.000000
04-24 12:16:07 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 12.000000
04-24 12:16:07 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 226.000000
04-24 12:16:07 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 68.000000
04-24 12:16:07 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 7.000000
04-24 12:16:07 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35470.000000
04-24 12:16:07 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 100.000000
04-24 12:16:07 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_card
04-24 12:16:07 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 12:16:07 I/MeasurementPrinter:           100.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 12:16:07 E/TvtsBaseAssistantTest: Run 4/20 encountered exception. See logs for details
04-24 12:16:07 E/TvtsBaseAssistantTest: MoonTest failed: 
com.google.android.assistant.tvts.MoonTest:
Error in testMoonResponse(com.google.android.assistant.tvts.MoonTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)


Time: 65.511
There was 1 failure:
1) testMoonResponse(com.google.android.assistant.tvts.MoonTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 12:16:07 D/RunUtil: Running command null without timeout.
04-24 12:16:07 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:16:07 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:16:07 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:16:08 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:16:08 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:16:08 D/RunUtil: Running command null without timeout.
04-24 12:16:08 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:16:08 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:16:08 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:16:08 D/RunUtil: Running command null without timeout.
04-24 12:16:08 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:16:08 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:16:08 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:16:08 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 12:16:08 I/DeviceStateMonitor: Waiting 359938 ms for device SKBFXYZO0C1V package manager
04-24 12:16:09 I/NativeDeviceStateMonitor: Waiting 359876 ms for device SKBFXYZO0C1V external store
04-24 12:16:10 D/RunUtil: Running command null without timeout.
04-24 12:16:10 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:16:11 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:16:11 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:16:11 D/RunUtil: Running command null without timeout.
04-24 12:16:11 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:16:11 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:16:11 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:16:11 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:16:11 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 12:16:11 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:16:12 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T20_10_12.086_8219683429096576079.txt] without timeout.
04-24 12:16:12 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 12:16:12 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 12:16:12 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 12:16:12 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.MoonTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 12:17:19 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:17:20 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 12:17:20 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 12:17:20 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 409.000000
04-24 12:17:20 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 53.000000
04-24 12:17:20 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 202.000000
04-24 12:17:20 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 119.000000
04-24 12:17:20 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 10.000000
04-24 12:17:20 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35469.000000
04-24 12:17:20 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 145.000000
04-24 12:17:20 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 12:17:20 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:17:20 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 12:17:20 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 12:17:20 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 409.000000
04-24 12:17:20 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 53.000000
04-24 12:17:20 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 202.000000
04-24 12:17:20 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 119.000000
04-24 12:17:20 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 10.000000
04-24 12:17:20 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35469.000000
04-24 12:17:20 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 145.000000
04-24 12:17:20 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 12:17:20 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 12:17:20 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:17:20 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 12:17:20 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 12:17:20 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 409.000000
04-24 12:17:20 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 53.000000
04-24 12:17:20 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 202.000000
04-24 12:17:20 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 119.000000
04-24 12:17:20 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 10.000000
04-24 12:17:20 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35469.000000
04-24 12:17:20 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 145.000000
04-24 12:17:20 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_card
04-24 12:17:20 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 12:17:20 I/MeasurementPrinter:           145.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 12:17:20 E/TvtsBaseAssistantTest: Run 5/20 encountered exception. See logs for details
04-24 12:17:20 E/TvtsBaseAssistantTest: MoonTest failed: 
com.google.android.assistant.tvts.MoonTest:
Error in testMoonResponse(com.google.android.assistant.tvts.MoonTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)


Time: 65.4
There was 1 failure:
1) testMoonResponse(com.google.android.assistant.tvts.MoonTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 12:17:20 D/RunUtil: Running command null without timeout.
04-24 12:17:20 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:17:21 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:17:21 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:17:21 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:17:21 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:17:21 D/RunUtil: Running command null without timeout.
04-24 12:17:21 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:17:21 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:17:21 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:17:21 D/RunUtil: Running command null without timeout.
04-24 12:17:21 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:17:22 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:17:22 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:17:22 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 12:17:22 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
04-24 12:17:22 I/NativeDeviceStateMonitor: Waiting 359903 ms for device SKBFXYZO0C1V external store
04-24 12:17:24 D/RunUtil: Running command null without timeout.
04-24 12:17:24 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:17:24 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:17:24 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:17:24 D/RunUtil: Running command null without timeout.
04-24 12:17:24 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:17:24 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:17:24 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:17:24 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:17:24 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 12:17:25 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:17:25 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T20_10_12.086_15203372651607023274.txt] without timeout.
04-24 12:17:25 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 12:17:25 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 12:17:25 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 12:17:25 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.MoonTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 12:18:33 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:18:33 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 12:18:33 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 8.000000
04-24 12:18:33 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 416.000000
04-24 12:18:33 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 31.000000
04-24 12:18:33 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 183.000000
04-24 12:18:33 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 132.000000
04-24 12:18:33 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 12.000000
04-24 12:18:33 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35493.000000
04-24 12:18:33 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 109.000000
04-24 12:18:33 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 12:18:33 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:18:33 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 12:18:33 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 8.000000
04-24 12:18:33 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 416.000000
04-24 12:18:33 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 31.000000
04-24 12:18:33 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 183.000000
04-24 12:18:33 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 132.000000
04-24 12:18:33 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 12.000000
04-24 12:18:33 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35493.000000
04-24 12:18:33 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 109.000000
04-24 12:18:33 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 12:18:33 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 12:18:33 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:18:33 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 12:18:33 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 8.000000
04-24 12:18:33 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 416.000000
04-24 12:18:33 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 31.000000
04-24 12:18:33 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 183.000000
04-24 12:18:33 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 132.000000
04-24 12:18:33 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 12.000000
04-24 12:18:33 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35493.000000
04-24 12:18:33 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 109.000000
04-24 12:18:33 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_card
04-24 12:18:33 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 12:18:33 I/MeasurementPrinter:           109.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 12:18:33 E/TvtsBaseAssistantTest: Run 6/20 encountered exception. See logs for details
04-24 12:18:33 E/TvtsBaseAssistantTest: MoonTest failed: 
com.google.android.assistant.tvts.MoonTest:
Error in testMoonResponse(com.google.android.assistant.tvts.MoonTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)


Time: 65.333
There was 1 failure:
1) testMoonResponse(com.google.android.assistant.tvts.MoonTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 12:18:33 D/RunUtil: Running command null without timeout.
04-24 12:18:33 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:18:34 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:18:34 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:18:34 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:18:34 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:18:34 D/RunUtil: Running command null without timeout.
04-24 12:18:34 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:18:35 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:18:35 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:18:35 D/RunUtil: Running command null without timeout.
04-24 12:18:35 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:18:35 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:18:35 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:18:35 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 12:18:35 I/DeviceStateMonitor: Waiting 359963 ms for device SKBFXYZO0C1V package manager
04-24 12:18:35 I/NativeDeviceStateMonitor: Waiting 359901 ms for device SKBFXYZO0C1V external store
04-24 12:18:37 D/RunUtil: Running command null without timeout.
04-24 12:18:37 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:18:37 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:18:37 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:18:37 D/RunUtil: Running command null without timeout.
04-24 12:18:37 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:18:37 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:18:37 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:18:38 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:18:38 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 12:18:38 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:18:38 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T20_10_12.086_11011900730312628596.txt] without timeout.
04-24 12:18:38 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 12:18:38 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 12:18:38 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 12:18:38 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.MoonTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 12:19:45 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:19:46 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 12:19:46 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 6.000000
04-24 12:19:46 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 582.000000
04-24 12:19:46 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
04-24 12:19:46 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 3.000000
04-24 12:19:46 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 38.000000
04-24 12:19:46 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 117.000000
04-24 12:19:46 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 189.000000
04-24 12:19:46 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 17.000000
04-24 12:19:46 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 19.000000
04-24 12:19:46 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 320.000000
04-24 12:19:46 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 16.000000
04-24 12:19:46 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35497.000000
04-24 12:19:46 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 77.000000
04-24 12:19:46 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 131.000000
04-24 12:19:46 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 12:19:46 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:19:46 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 12:19:46 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 6.000000
04-24 12:19:46 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 582.000000
04-24 12:19:46 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
04-24 12:19:46 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 3.000000
04-24 12:19:46 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 38.000000
04-24 12:19:46 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 117.000000
04-24 12:19:46 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 189.000000
04-24 12:19:46 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 17.000000
04-24 12:19:46 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 19.000000
04-24 12:19:46 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 320.000000
04-24 12:19:46 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 16.000000
04-24 12:19:46 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35497.000000
04-24 12:19:46 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 77.000000
04-24 12:19:46 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 131.000000
04-24 12:19:46 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 12:19:46 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 12:19:46 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:19:46 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 12:19:46 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 6.000000
04-24 12:19:46 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 582.000000
04-24 12:19:46 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
04-24 12:19:46 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 3.000000
04-24 12:19:46 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 38.000000
04-24 12:19:46 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 117.000000
04-24 12:19:46 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 189.000000
04-24 12:19:46 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 17.000000
04-24 12:19:46 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 19.000000
04-24 12:19:46 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 320.000000
04-24 12:19:46 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 16.000000
04-24 12:19:46 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35497.000000
04-24 12:19:46 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 77.000000
04-24 12:19:46 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 131.000000
04-24 12:19:46 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_card
04-24 12:19:46 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 12:19:46 I/MeasurementPrinter:           131.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 12:19:46 E/TvtsBaseAssistantTest: Run 7/20 encountered exception. See logs for details
04-24 12:19:46 E/TvtsBaseAssistantTest: MoonTest failed: 
com.google.android.assistant.tvts.MoonTest:
Error in testMoonResponse(com.google.android.assistant.tvts.MoonTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)


Time: 65.342
There was 1 failure:
1) testMoonResponse(com.google.android.assistant.tvts.MoonTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 12:19:46 D/RunUtil: Running command null without timeout.
04-24 12:19:46 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:19:47 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:19:47 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:19:47 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:19:47 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:19:47 D/RunUtil: Running command null without timeout.
04-24 12:19:47 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:19:47 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:19:47 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:19:47 D/RunUtil: Running command null without timeout.
04-24 12:19:47 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:19:48 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:19:48 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:19:48 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 12:19:48 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
04-24 12:19:48 I/NativeDeviceStateMonitor: Waiting 359901 ms for device SKBFXYZO0C1V external store
04-24 12:19:49 D/RunUtil: Running command null without timeout.
04-24 12:19:50 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:19:50 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:19:50 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:19:50 D/RunUtil: Running command null without timeout.
04-24 12:19:50 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:19:50 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:19:50 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:19:50 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:19:50 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 12:19:50 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:19:51 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T20_10_12.086_16642593114013095995.txt] without timeout.
04-24 12:19:51 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 12:19:51 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 12:19:51 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 12:19:51 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.MoonTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 12:20:58 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:20:58 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 12:20:58 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 4.000000
04-24 12:20:58 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 393.000000
04-24 12:20:58 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 31.000000
04-24 12:20:58 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 224.000000
04-24 12:20:58 D/ProtoMeasurementBase: searchbar_state_listening: size = 3, sum: 242.000000
04-24 12:20:58 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 4.000000
04-24 12:20:58 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35499.000000
04-24 12:20:58 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 117.000000
04-24 12:20:58 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 12:20:58 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:20:58 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 12:20:58 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 4.000000
04-24 12:20:58 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 393.000000
04-24 12:20:58 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 31.000000
04-24 12:20:58 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 224.000000
04-24 12:20:58 D/ProtoMeasurementBase: searchbar_state_listening: size = 3, sum: 242.000000
04-24 12:20:58 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 4.000000
04-24 12:20:58 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35499.000000
04-24 12:20:58 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 117.000000
04-24 12:20:58 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 12:20:58 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 12:20:58 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:20:59 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 12:20:59 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 4.000000
04-24 12:20:59 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 393.000000
04-24 12:20:59 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 31.000000
04-24 12:20:59 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 224.000000
04-24 12:20:59 D/ProtoMeasurementBase: searchbar_state_listening: size = 3, sum: 242.000000
04-24 12:20:59 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 4.000000
04-24 12:20:59 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35499.000000
04-24 12:20:59 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 117.000000
04-24 12:20:59 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_card
04-24 12:20:59 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 12:20:59 I/MeasurementPrinter:           117.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 12:20:59 E/TvtsBaseAssistantTest: Run 8/20 encountered exception. See logs for details
04-24 12:20:59 E/TvtsBaseAssistantTest: MoonTest failed: 
com.google.android.assistant.tvts.MoonTest:
Error in testMoonResponse(com.google.android.assistant.tvts.MoonTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)


Time: 65.285
There was 1 failure:
1) testMoonResponse(com.google.android.assistant.tvts.MoonTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 12:20:59 D/RunUtil: Running command null without timeout.
04-24 12:20:59 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:20:59 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:20:59 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:20:59 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:21:00 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:21:00 D/RunUtil: Running command null without timeout.
04-24 12:21:00 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:21:00 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:21:00 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:21:00 D/RunUtil: Running command null without timeout.
04-24 12:21:00 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:21:00 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:21:00 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:21:00 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 12:21:00 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
04-24 12:21:00 I/NativeDeviceStateMonitor: Waiting 359902 ms for device SKBFXYZO0C1V external store
04-24 12:21:02 D/RunUtil: Running command null without timeout.
04-24 12:21:02 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:21:02 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:21:02 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:21:02 D/RunUtil: Running command null without timeout.
04-24 12:21:02 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:21:02 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:21:03 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:21:03 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:21:03 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 12:21:03 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:21:03 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T20_10_12.086_13826084375662405903.txt] without timeout.
04-24 12:21:04 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 12:21:04 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 12:21:04 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 12:21:04 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.MoonTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 12:22:11 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:22:11 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 12:22:11 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 12:22:11 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 518.000000
04-24 12:22:11 D/ProtoMeasurementBase: IDLE_AFTER_UI_DISMISSED: size = 1, sum: 0.000000
04-24 12:22:11 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 17.000000
04-24 12:22:11 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 187.000000
04-24 12:22:11 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 232.000000
04-24 12:22:11 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 6.000000
04-24 12:22:11 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35491.000000
04-24 12:22:11 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 117.000000
04-24 12:22:11 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 12:22:11 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:22:11 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 12:22:11 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 12:22:11 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 518.000000
04-24 12:22:11 D/ProtoMeasurementBase: IDLE_AFTER_UI_DISMISSED: size = 1, sum: 0.000000
04-24 12:22:11 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 17.000000
04-24 12:22:11 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 187.000000
04-24 12:22:11 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 232.000000
04-24 12:22:11 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 6.000000
04-24 12:22:11 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35491.000000
04-24 12:22:11 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 117.000000
04-24 12:22:11 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 12:22:11 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 12:22:11 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:22:11 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 12:22:11 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 12:22:11 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 518.000000
04-24 12:22:11 D/ProtoMeasurementBase: IDLE_AFTER_UI_DISMISSED: size = 1, sum: 0.000000
04-24 12:22:11 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 17.000000
04-24 12:22:11 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 187.000000
04-24 12:22:11 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 232.000000
04-24 12:22:11 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 6.000000
04-24 12:22:12 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35491.000000
04-24 12:22:12 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 117.000000
04-24 12:22:12 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_card
04-24 12:22:12 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 12:22:12 I/MeasurementPrinter:           117.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 12:22:12 E/TvtsBaseAssistantTest: Run 9/20 encountered exception. See logs for details
04-24 12:22:12 E/TvtsBaseAssistantTest: MoonTest failed: 
com.google.android.assistant.tvts.MoonTest:
Error in testMoonResponse(com.google.android.assistant.tvts.MoonTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)


Time: 65.383
There was 1 failure:
1) testMoonResponse(com.google.android.assistant.tvts.MoonTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 12:22:12 D/RunUtil: Running command null without timeout.
04-24 12:22:12 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:22:12 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:22:12 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:22:12 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:22:13 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:22:13 D/RunUtil: Running command null without timeout.
04-24 12:22:13 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:22:13 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:22:13 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:22:13 D/RunUtil: Running command null without timeout.
04-24 12:22:13 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:22:13 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:22:13 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:22:13 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 12:22:13 I/DeviceStateMonitor: Waiting 359963 ms for device SKBFXYZO0C1V package manager
04-24 12:22:13 I/NativeDeviceStateMonitor: Waiting 359901 ms for device SKBFXYZO0C1V external store
04-24 12:22:15 D/RunUtil: Running command null without timeout.
04-24 12:22:15 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:22:15 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:22:15 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:22:15 D/RunUtil: Running command null without timeout.
04-24 12:22:15 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:22:15 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:22:15 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:22:16 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:22:16 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 12:22:16 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:22:16 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T20_10_12.086_16620319373031034729.txt] without timeout.
04-24 12:22:17 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 12:22:17 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 12:22:17 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 12:22:17 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.MoonTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 12:23:24 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:23:24 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 12:23:24 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 4.000000
04-24 12:23:24 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 373.000000
04-24 12:23:24 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 16.000000
04-24 12:23:24 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 195.000000
04-24 12:23:24 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 67.000000
04-24 12:23:24 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 18.000000
04-24 12:23:24 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35470.000000
04-24 12:23:24 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 108.000000
04-24 12:23:24 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 12:23:24 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:23:24 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 12:23:24 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 4.000000
04-24 12:23:24 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 373.000000
04-24 12:23:24 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 16.000000
04-24 12:23:24 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 195.000000
04-24 12:23:24 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 67.000000
04-24 12:23:24 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 18.000000
04-24 12:23:24 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35470.000000
04-24 12:23:24 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 108.000000
04-24 12:23:24 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 12:23:24 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 12:23:24 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:23:24 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 12:23:24 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 4.000000
04-24 12:23:24 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 373.000000
04-24 12:23:24 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 16.000000
04-24 12:23:24 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 195.000000
04-24 12:23:24 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 67.000000
04-24 12:23:24 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 18.000000
04-24 12:23:24 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35470.000000
04-24 12:23:24 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 108.000000
04-24 12:23:24 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_card
04-24 12:23:24 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 12:23:24 I/MeasurementPrinter:           108.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 12:23:24 E/TvtsBaseAssistantTest: Run 10/20 encountered exception. See logs for details
04-24 12:23:24 E/TvtsBaseAssistantTest: MoonTest failed: 
com.google.android.assistant.tvts.MoonTest:
Error in testMoonResponse(com.google.android.assistant.tvts.MoonTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)


Time: 65.222
There was 1 failure:
1) testMoonResponse(com.google.android.assistant.tvts.MoonTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 12:23:24 D/RunUtil: Running command null without timeout.
04-24 12:23:24 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:23:25 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:23:25 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:23:25 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:23:26 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:23:26 D/RunUtil: Running command null without timeout.
04-24 12:23:26 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:23:26 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:23:26 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:23:26 D/RunUtil: Running command null without timeout.
04-24 12:23:26 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:23:26 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:23:26 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:23:26 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
04-24 12:23:26 I/DeviceStateMonitor: Waiting 359958 ms for device SKBFXYZO0C1V package manager
04-24 12:23:26 I/NativeDeviceStateMonitor: Waiting 359896 ms for device SKBFXYZO0C1V external store
04-24 12:23:28 D/RunUtil: Running command null without timeout.
04-24 12:23:28 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:23:28 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:23:28 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:23:28 D/RunUtil: Running command null without timeout.
04-24 12:23:28 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:23:28 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:23:28 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:23:29 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:23:29 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 12:23:29 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:23:29 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T20_10_12.086_8095459062127987122.txt] without timeout.
04-24 12:23:29 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 12:23:29 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 12:23:29 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 12:23:29 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.MoonTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 12:24:37 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:24:37 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 12:24:37 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 7.000000
04-24 12:24:37 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 382.000000
04-24 12:24:37 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 13.000000
04-24 12:24:37 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 179.000000
04-24 12:24:37 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 80.000000
04-24 12:24:37 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 11.000000
04-24 12:24:37 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35465.000000
04-24 12:24:37 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 92.000000
04-24 12:24:37 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 12:24:37 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:24:37 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 12:24:37 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 7.000000
04-24 12:24:37 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 382.000000
04-24 12:24:37 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 13.000000
04-24 12:24:37 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 179.000000
04-24 12:24:37 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 80.000000
04-24 12:24:37 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 11.000000
04-24 12:24:37 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35465.000000
04-24 12:24:37 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 92.000000
04-24 12:24:37 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 12:24:37 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 12:24:37 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:24:37 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 12:24:37 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 7.000000
04-24 12:24:37 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 382.000000
04-24 12:24:37 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 13.000000
04-24 12:24:37 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 179.000000
04-24 12:24:37 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 80.000000
04-24 12:24:37 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 11.000000
04-24 12:24:37 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35465.000000
04-24 12:24:37 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 92.000000
04-24 12:24:37 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_card
04-24 12:24:37 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 12:24:37 I/MeasurementPrinter:            92.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 12:24:37 E/TvtsBaseAssistantTest: Run 11/20 encountered exception. See logs for details
04-24 12:24:37 E/TvtsBaseAssistantTest: MoonTest failed: 
com.google.android.assistant.tvts.MoonTest:
Error in testMoonResponse(com.google.android.assistant.tvts.MoonTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)


Time: 65.317
There was 1 failure:
1) testMoonResponse(com.google.android.assistant.tvts.MoonTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 12:24:37 D/RunUtil: Running command null without timeout.
04-24 12:24:37 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:24:38 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:24:38 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:24:38 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:24:38 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:24:38 D/RunUtil: Running command null without timeout.
04-24 12:24:39 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:24:39 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:24:39 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:24:39 D/RunUtil: Running command null without timeout.
04-24 12:24:39 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:24:39 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:24:39 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:24:39 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 12:24:39 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
04-24 12:24:39 I/NativeDeviceStateMonitor: Waiting 359902 ms for device SKBFXYZO0C1V external store
04-24 12:24:41 D/RunUtil: Running command null without timeout.
04-24 12:24:41 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:24:41 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:24:41 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:24:41 D/RunUtil: Running command null without timeout.
04-24 12:24:41 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:24:41 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:24:41 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:24:42 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:24:42 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 12:24:42 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:24:42 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T20_10_12.086_4056480192187534001.txt] without timeout.
04-24 12:24:42 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 12:24:42 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 12:24:42 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 12:24:42 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.MoonTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 12:25:49 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:25:50 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 12:25:50 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 12:25:50 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 416.000000
04-24 12:25:50 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 21.000000
04-24 12:25:50 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 190.000000
04-24 12:25:50 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 92.000000
04-24 12:25:50 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 6.000000
04-24 12:25:50 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35498.000000
04-24 12:25:50 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 109.000000
04-24 12:25:50 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 12:25:50 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:25:50 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 12:25:50 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 12:25:50 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 416.000000
04-24 12:25:50 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 21.000000
04-24 12:25:50 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 190.000000
04-24 12:25:50 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 92.000000
04-24 12:25:50 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 6.000000
04-24 12:25:50 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35498.000000
04-24 12:25:50 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 109.000000
04-24 12:25:50 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 12:25:50 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 12:25:50 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:25:50 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 12:25:50 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 12:25:50 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 416.000000
04-24 12:25:50 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 21.000000
04-24 12:25:50 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 190.000000
04-24 12:25:50 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 92.000000
04-24 12:25:50 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 6.000000
04-24 12:25:50 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35498.000000
04-24 12:25:50 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 109.000000
04-24 12:25:50 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_card
04-24 12:25:50 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 12:25:50 I/MeasurementPrinter:           109.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 12:25:50 E/TvtsBaseAssistantTest: Run 12/20 encountered exception. See logs for details
04-24 12:25:50 E/TvtsBaseAssistantTest: MoonTest failed: 
com.google.android.assistant.tvts.MoonTest:
Error in testMoonResponse(com.google.android.assistant.tvts.MoonTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)


Time: 65.229
There was 1 failure:
1) testMoonResponse(com.google.android.assistant.tvts.MoonTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 12:25:50 D/RunUtil: Running command null without timeout.
04-24 12:25:50 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:25:51 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:25:51 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:25:51 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:25:51 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:25:51 D/RunUtil: Running command null without timeout.
04-24 12:25:51 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:25:51 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:25:51 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:25:51 D/RunUtil: Running command null without timeout.
04-24 12:25:51 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:25:52 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:25:52 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:25:52 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 12:25:52 I/DeviceStateMonitor: Waiting 359963 ms for device SKBFXYZO0C1V package manager
04-24 12:25:52 I/NativeDeviceStateMonitor: Waiting 359902 ms for device SKBFXYZO0C1V external store
04-24 12:25:54 D/RunUtil: Running command null without timeout.
04-24 12:25:54 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:25:54 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:25:54 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:25:54 D/RunUtil: Running command null without timeout.
04-24 12:25:54 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:25:54 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:25:54 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:25:54 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:25:54 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 12:25:55 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:25:55 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T20_10_12.086_7987743368577036685.txt] without timeout.
04-24 12:25:55 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 12:25:55 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 12:25:55 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 12:25:55 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.MoonTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 12:27:02 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:27:02 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 12:27:02 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 4.000000
04-24 12:27:02 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 335.000000
04-24 12:27:02 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 11.000000
04-24 12:27:02 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 154.000000
04-24 12:27:02 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 84.000000
04-24 12:27:02 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 18.000000
04-24 12:27:02 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35515.000000
04-24 12:27:02 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 76.000000
04-24 12:27:02 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 12:27:02 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:27:03 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 12:27:03 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 4.000000
04-24 12:27:03 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 335.000000
04-24 12:27:03 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 11.000000
04-24 12:27:03 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 154.000000
04-24 12:27:03 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 84.000000
04-24 12:27:03 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 18.000000
04-24 12:27:03 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35515.000000
04-24 12:27:03 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 76.000000
04-24 12:27:03 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 12:27:03 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 12:27:03 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:27:03 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 12:27:03 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 4.000000
04-24 12:27:03 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 335.000000
04-24 12:27:03 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 11.000000
04-24 12:27:03 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 154.000000
04-24 12:27:03 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 84.000000
04-24 12:27:03 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 18.000000
04-24 12:27:03 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35515.000000
04-24 12:27:03 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 76.000000
04-24 12:27:03 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_card
04-24 12:27:03 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 12:27:03 I/MeasurementPrinter:            76.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 12:27:03 E/TvtsBaseAssistantTest: Run 13/20 encountered exception. See logs for details
04-24 12:27:03 E/TvtsBaseAssistantTest: MoonTest failed: 
com.google.android.assistant.tvts.MoonTest:
Error in testMoonResponse(com.google.android.assistant.tvts.MoonTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)


Time: 65.265
There was 1 failure:
1) testMoonResponse(com.google.android.assistant.tvts.MoonTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 12:27:03 D/RunUtil: Running command null without timeout.
04-24 12:27:03 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:27:03 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:27:03 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:27:04 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:27:04 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:27:04 D/RunUtil: Running command null without timeout.
04-24 12:27:04 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:27:04 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:27:04 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:27:04 D/RunUtil: Running command null without timeout.
04-24 12:27:04 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:27:04 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:27:04 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:27:04 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 12:27:04 I/DeviceStateMonitor: Waiting 359963 ms for device SKBFXYZO0C1V package manager
04-24 12:27:05 I/NativeDeviceStateMonitor: Waiting 359902 ms for device SKBFXYZO0C1V external store
04-24 12:27:06 D/RunUtil: Running command null without timeout.
04-24 12:27:06 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:27:07 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:27:07 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:27:07 D/RunUtil: Running command null without timeout.
04-24 12:27:07 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:27:07 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:27:07 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:27:07 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:27:07 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 12:27:07 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:27:07 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T20_10_12.086_7613860767882424684.txt] without timeout.
04-24 12:27:08 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 12:27:08 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 12:27:08 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 12:27:08 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.MoonTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 12:28:15 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:28:15 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 12:28:15 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 12:28:15 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 406.000000
04-24 12:28:15 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 12.000000
04-24 12:28:15 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 156.000000
04-24 12:28:15 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 111.000000
04-24 12:28:15 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 5.000000
04-24 12:28:15 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35453.000000
04-24 12:28:15 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 88.000000
04-24 12:28:15 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 12:28:15 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:28:15 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 12:28:15 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 12:28:15 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 406.000000
04-24 12:28:15 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 12.000000
04-24 12:28:15 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 156.000000
04-24 12:28:15 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 111.000000
04-24 12:28:15 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 5.000000
04-24 12:28:15 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35453.000000
04-24 12:28:15 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 88.000000
04-24 12:28:15 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 12:28:15 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 12:28:15 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:28:16 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 12:28:16 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 12:28:16 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 406.000000
04-24 12:28:16 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 12.000000
04-24 12:28:16 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 156.000000
04-24 12:28:16 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 111.000000
04-24 12:28:16 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 5.000000
04-24 12:28:16 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35453.000000
04-24 12:28:16 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 88.000000
04-24 12:28:16 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_card
04-24 12:28:16 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 12:28:16 I/MeasurementPrinter:            88.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 12:28:16 E/TvtsBaseAssistantTest: Run 14/20 encountered exception. See logs for details
04-24 12:28:16 E/TvtsBaseAssistantTest: MoonTest failed: 
com.google.android.assistant.tvts.MoonTest:
Error in testMoonResponse(com.google.android.assistant.tvts.MoonTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)


Time: 65.279
There was 1 failure:
1) testMoonResponse(com.google.android.assistant.tvts.MoonTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 12:28:16 D/RunUtil: Running command null without timeout.
04-24 12:28:16 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:28:16 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:28:16 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:28:16 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:28:17 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:28:17 D/RunUtil: Running command null without timeout.
04-24 12:28:17 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:28:17 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:28:17 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:28:17 D/RunUtil: Running command null without timeout.
04-24 12:28:17 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:28:17 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:28:17 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:28:17 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 12:28:17 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
04-24 12:28:17 I/NativeDeviceStateMonitor: Waiting 359901 ms for device SKBFXYZO0C1V external store
04-24 12:28:19 D/RunUtil: Running command null without timeout.
04-24 12:28:19 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:28:19 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:28:19 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:28:19 D/RunUtil: Running command null without timeout.
04-24 12:28:19 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:28:19 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:28:19 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:28:20 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:28:20 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 12:28:20 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:28:20 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T20_10_12.086_3329488052477234662.txt] without timeout.
04-24 12:28:21 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 12:28:21 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 12:28:21 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 12:28:21 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.MoonTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 12:29:28 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:29:28 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 12:29:28 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 12:29:28 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 331.000000
04-24 12:29:28 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 11.000000
04-24 12:29:28 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 197.000000
04-24 12:29:28 D/ProtoMeasurementBase: searchbar_state_listening: size = 3, sum: 195.000000
04-24 12:29:28 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 2.000000
04-24 12:29:28 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35499.000000
04-24 12:29:28 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 75.000000
04-24 12:29:28 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 12:29:28 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:29:28 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 12:29:28 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 12:29:28 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 331.000000
04-24 12:29:28 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 11.000000
04-24 12:29:28 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 197.000000
04-24 12:29:28 D/ProtoMeasurementBase: searchbar_state_listening: size = 3, sum: 195.000000
04-24 12:29:28 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 2.000000
04-24 12:29:28 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35499.000000
04-24 12:29:28 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 75.000000
04-24 12:29:28 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 12:29:28 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 12:29:28 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:29:28 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 12:29:28 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 12:29:28 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 331.000000
04-24 12:29:28 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 11.000000
04-24 12:29:28 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 197.000000
04-24 12:29:28 D/ProtoMeasurementBase: searchbar_state_listening: size = 3, sum: 195.000000
04-24 12:29:28 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 2.000000
04-24 12:29:28 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35499.000000
04-24 12:29:28 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 75.000000
04-24 12:29:28 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_card
04-24 12:29:28 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 12:29:28 I/MeasurementPrinter:            75.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 12:29:28 E/TvtsBaseAssistantTest: Run 15/20 encountered exception. See logs for details
04-24 12:29:28 E/TvtsBaseAssistantTest: MoonTest failed: 
com.google.android.assistant.tvts.MoonTest:
Error in testMoonResponse(com.google.android.assistant.tvts.MoonTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)


Time: 65.24
There was 1 failure:
1) testMoonResponse(com.google.android.assistant.tvts.MoonTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 12:29:28 D/RunUtil: Running command null without timeout.
04-24 12:29:28 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:29:29 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:29:29 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:29:29 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:29:30 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:29:30 D/RunUtil: Running command null without timeout.
04-24 12:29:30 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:29:30 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:29:30 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:29:30 D/RunUtil: Running command null without timeout.
04-24 12:29:30 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:29:30 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:29:30 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:29:30 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 12:29:30 I/DeviceStateMonitor: Waiting 359963 ms for device SKBFXYZO0C1V package manager
04-24 12:29:30 I/NativeDeviceStateMonitor: Waiting 359901 ms for device SKBFXYZO0C1V external store
04-24 12:29:32 D/RunUtil: Running command null without timeout.
04-24 12:29:32 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:29:32 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:29:32 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:29:32 D/RunUtil: Running command null without timeout.
04-24 12:29:32 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:29:32 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:29:32 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:29:33 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:29:33 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 12:29:33 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:29:33 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T20_10_12.086_7050788332991431555.txt] without timeout.
04-24 12:29:33 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 12:29:33 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 12:29:33 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 12:29:33 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.MoonTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 12:30:41 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:30:41 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 12:30:41 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 13.000000
04-24 12:30:41 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 434.000000
04-24 12:30:41 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 28.000000
04-24 12:30:41 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 214.000000
04-24 12:30:41 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 115.000000
04-24 12:30:41 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 3.000000
04-24 12:30:41 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35492.000000
04-24 12:30:41 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 102.000000
04-24 12:30:41 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 12:30:41 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:30:41 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 12:30:41 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 13.000000
04-24 12:30:41 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 434.000000
04-24 12:30:41 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 28.000000
04-24 12:30:41 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 214.000000
04-24 12:30:41 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 115.000000
04-24 12:30:41 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 3.000000
04-24 12:30:41 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35492.000000
04-24 12:30:41 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 102.000000
04-24 12:30:41 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 12:30:41 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 12:30:41 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:30:41 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 12:30:41 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 13.000000
04-24 12:30:41 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 434.000000
04-24 12:30:41 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 28.000000
04-24 12:30:41 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 214.000000
04-24 12:30:41 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 115.000000
04-24 12:30:41 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 3.000000
04-24 12:30:41 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35492.000000
04-24 12:30:41 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 102.000000
04-24 12:30:41 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_card
04-24 12:30:41 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 12:30:41 I/MeasurementPrinter:           102.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 12:30:41 E/TvtsBaseAssistantTest: Run 16/20 encountered exception. See logs for details
04-24 12:30:41 E/TvtsBaseAssistantTest: MoonTest failed: 
com.google.android.assistant.tvts.MoonTest:
Error in testMoonResponse(com.google.android.assistant.tvts.MoonTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)


Time: 65.277
There was 1 failure:
1) testMoonResponse(com.google.android.assistant.tvts.MoonTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 12:30:41 D/RunUtil: Running command null without timeout.
04-24 12:30:41 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:30:42 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:30:42 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:30:42 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:30:43 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:30:43 D/RunUtil: Running command null without timeout.
04-24 12:30:43 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:30:43 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:30:43 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:30:43 D/RunUtil: Running command null without timeout.
04-24 12:30:43 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:30:43 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:30:43 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:30:43 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 12:30:43 I/DeviceStateMonitor: Waiting 359963 ms for device SKBFXYZO0C1V package manager
04-24 12:30:43 I/NativeDeviceStateMonitor: Waiting 359895 ms for device SKBFXYZO0C1V external store
04-24 12:30:45 D/RunUtil: Running command null without timeout.
04-24 12:30:45 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:30:45 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:30:45 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:30:45 D/RunUtil: Running command null without timeout.
04-24 12:30:45 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:30:45 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:30:45 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:30:46 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:30:46 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 12:30:46 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:30:46 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T20_10_12.086_11725274885593215617.txt] without timeout.
04-24 12:30:46 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 12:30:46 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 12:30:46 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 12:30:46 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.MoonTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 12:31:54 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:31:54 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 12:31:54 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 11.000000
04-24 12:31:54 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 360.000000
04-24 12:31:54 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 40.000000
04-24 12:31:54 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 206.000000
04-24 12:31:54 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 39.000000
04-24 12:31:54 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 16.000000
04-24 12:31:54 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35549.000000
04-24 12:31:54 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 142.000000
04-24 12:31:54 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 12:31:54 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:31:54 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 12:31:54 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 11.000000
04-24 12:31:54 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 360.000000
04-24 12:31:54 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 40.000000
04-24 12:31:54 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 206.000000
04-24 12:31:54 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 39.000000
04-24 12:31:54 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 16.000000
04-24 12:31:54 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35549.000000
04-24 12:31:54 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 142.000000
04-24 12:31:54 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 12:31:54 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 12:31:54 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:31:54 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 12:31:54 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 11.000000
04-24 12:31:54 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 360.000000
04-24 12:31:54 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 40.000000
04-24 12:31:54 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 206.000000
04-24 12:31:54 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 39.000000
04-24 12:31:54 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 16.000000
04-24 12:31:54 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35549.000000
04-24 12:31:54 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 142.000000
04-24 12:31:54 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_card
04-24 12:31:54 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 12:31:54 I/MeasurementPrinter:           142.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 12:31:54 E/TvtsBaseAssistantTest: Run 17/20 encountered exception. See logs for details
04-24 12:31:54 E/TvtsBaseAssistantTest: MoonTest failed: 
com.google.android.assistant.tvts.MoonTest:
Error in testMoonResponse(com.google.android.assistant.tvts.MoonTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)


Time: 65.278
There was 1 failure:
1) testMoonResponse(com.google.android.assistant.tvts.MoonTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 12:31:54 D/RunUtil: Running command null without timeout.
04-24 12:31:54 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:31:55 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:31:55 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:31:55 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:31:55 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:31:55 D/RunUtil: Running command null without timeout.
04-24 12:31:56 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:31:56 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:31:56 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:31:56 D/RunUtil: Running command null without timeout.
04-24 12:31:56 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:31:56 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:31:56 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:31:56 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 12:31:56 I/DeviceStateMonitor: Waiting 359963 ms for device SKBFXYZO0C1V package manager
04-24 12:31:56 I/NativeDeviceStateMonitor: Waiting 359901 ms for device SKBFXYZO0C1V external store
04-24 12:31:58 D/RunUtil: Running command null without timeout.
04-24 12:31:58 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:31:58 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:31:58 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:31:58 D/RunUtil: Running command null without timeout.
04-24 12:31:58 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:31:58 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:31:58 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:31:59 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:31:59 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 12:31:59 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:31:59 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T20_10_12.086_10997600736761604797.txt] without timeout.
04-24 12:31:59 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 12:31:59 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 12:31:59 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 12:31:59 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.MoonTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 12:33:06 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:33:06 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 12:33:06 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 12:33:06 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 424.000000
04-24 12:33:06 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 11.000000
04-24 12:33:06 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 193.000000
04-24 12:33:06 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 108.000000
04-24 12:33:06 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 8.000000
04-24 12:33:06 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35514.000000
04-24 12:33:06 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 82.000000
04-24 12:33:06 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 12:33:06 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:33:07 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 12:33:07 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 12:33:07 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 424.000000
04-24 12:33:07 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 11.000000
04-24 12:33:07 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 193.000000
04-24 12:33:07 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 108.000000
04-24 12:33:07 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 8.000000
04-24 12:33:07 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35514.000000
04-24 12:33:07 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 82.000000
04-24 12:33:07 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 12:33:07 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 12:33:07 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:33:07 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 12:33:07 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 12:33:07 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 424.000000
04-24 12:33:07 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 11.000000
04-24 12:33:07 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 193.000000
04-24 12:33:07 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 108.000000
04-24 12:33:07 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 8.000000
04-24 12:33:07 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35514.000000
04-24 12:33:07 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 82.000000
04-24 12:33:07 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_card
04-24 12:33:07 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 12:33:07 I/MeasurementPrinter:            82.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 12:33:07 E/TvtsBaseAssistantTest: Run 18/20 encountered exception. See logs for details
04-24 12:33:07 E/TvtsBaseAssistantTest: MoonTest failed: 
com.google.android.assistant.tvts.MoonTest:
Error in testMoonResponse(com.google.android.assistant.tvts.MoonTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)


Time: 65.205
There was 1 failure:
1) testMoonResponse(com.google.android.assistant.tvts.MoonTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 12:33:07 D/RunUtil: Running command null without timeout.
04-24 12:33:07 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:33:07 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:33:07 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:33:08 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:33:08 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:33:08 D/RunUtil: Running command null without timeout.
04-24 12:33:08 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:33:08 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:33:08 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:33:08 D/RunUtil: Running command null without timeout.
04-24 12:33:08 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:33:08 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:33:08 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:33:08 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 12:33:08 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
04-24 12:33:09 I/NativeDeviceStateMonitor: Waiting 359902 ms for device SKBFXYZO0C1V external store
04-24 12:33:10 D/RunUtil: Running command null without timeout.
04-24 12:33:11 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:33:11 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:33:11 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:33:11 D/RunUtil: Running command null without timeout.
04-24 12:33:11 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:33:11 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:33:11 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:33:11 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:33:11 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 12:33:12 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:33:12 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T20_10_12.086_3718699124347888060.txt] without timeout.
04-24 12:33:12 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 12:33:12 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 12:33:12 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 12:33:12 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.MoonTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 12:34:19 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:34:19 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 12:34:19 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 12:34:19 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 455.000000
04-24 12:34:19 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 2.000000
04-24 12:34:19 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
04-24 12:34:19 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 15.000000
04-24 12:34:19 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 69.000000
04-24 12:34:19 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 159.000000
04-24 12:34:19 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 6.000000
04-24 12:34:19 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 12.000000
04-24 12:34:19 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 193.000000
04-24 12:34:19 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 6.000000
04-24 12:34:19 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35452.000000
04-24 12:34:19 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 48.000000
04-24 12:34:19 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 79.000000
04-24 12:34:19 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 12:34:19 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:34:20 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 12:34:20 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 12:34:20 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 455.000000
04-24 12:34:20 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 2.000000
04-24 12:34:20 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
04-24 12:34:20 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 15.000000
04-24 12:34:20 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 69.000000
04-24 12:34:20 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 159.000000
04-24 12:34:20 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 6.000000
04-24 12:34:20 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 12.000000
04-24 12:34:20 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 193.000000
04-24 12:34:20 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 6.000000
04-24 12:34:20 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35452.000000
04-24 12:34:20 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 48.000000
04-24 12:34:20 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 79.000000
04-24 12:34:20 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 12:34:20 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 12:34:20 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:34:20 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 12:34:20 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 12:34:20 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 455.000000
04-24 12:34:20 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 2.000000
04-24 12:34:20 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
04-24 12:34:20 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 15.000000
04-24 12:34:20 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 69.000000
04-24 12:34:20 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 159.000000
04-24 12:34:20 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 6.000000
04-24 12:34:20 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 12.000000
04-24 12:34:20 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 193.000000
04-24 12:34:20 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 6.000000
04-24 12:34:20 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35452.000000
04-24 12:34:20 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 48.000000
04-24 12:34:20 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 79.000000
04-24 12:34:20 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_card
04-24 12:34:20 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 12:34:20 I/MeasurementPrinter:            79.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 12:34:20 E/TvtsBaseAssistantTest: Run 19/20 encountered exception. See logs for details
04-24 12:34:20 E/TvtsBaseAssistantTest: MoonTest failed: 
com.google.android.assistant.tvts.MoonTest:
Error in testMoonResponse(com.google.android.assistant.tvts.MoonTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)


Time: 65.31
There was 1 failure:
1) testMoonResponse(com.google.android.assistant.tvts.MoonTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 12:34:20 D/RunUtil: Running command null without timeout.
04-24 12:34:20 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:34:20 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:34:20 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:34:20 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:34:21 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:34:21 D/RunUtil: Running command null without timeout.
04-24 12:34:21 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:34:21 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:34:21 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:34:21 D/RunUtil: Running command null without timeout.
04-24 12:34:21 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:34:21 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:34:21 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 12:34:21 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 12:34:21 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
04-24 12:34:21 I/NativeDeviceStateMonitor: Waiting 359902 ms for device SKBFXYZO0C1V external store
04-24 12:34:23 D/RunUtil: Running command null without timeout.
04-24 12:34:23 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:34:23 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:34:23 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:34:23 D/RunUtil: Running command null without timeout.
04-24 12:34:23 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:34:24 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:34:24 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:34:24 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:34:24 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 12:34:24 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:34:24 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T20_10_12.086_10248849574040375335.txt] without timeout.
04-24 12:34:25 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 12:34:25 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 12:34:25 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 12:34:25 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.MoonTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 12:35:32 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:35:32 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 12:35:32 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 3.000000
04-24 12:35:32 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 328.000000
04-24 12:35:32 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 28.000000
04-24 12:35:32 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 175.000000
04-24 12:35:32 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 27.000000
04-24 12:35:32 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 4.000000
04-24 12:35:32 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35517.000000
04-24 12:35:32 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 99.000000
04-24 12:35:32 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 12:35:32 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:35:32 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 12:35:32 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 3.000000
04-24 12:35:32 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 328.000000
04-24 12:35:32 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 28.000000
04-24 12:35:32 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 175.000000
04-24 12:35:32 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 27.000000
04-24 12:35:32 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 4.000000
04-24 12:35:32 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35517.000000
04-24 12:35:32 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 99.000000
04-24 12:35:32 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 12:35:32 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 12:35:32 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:35:32 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 12:35:32 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 3.000000
04-24 12:35:32 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 328.000000
04-24 12:35:32 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 28.000000
04-24 12:35:32 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 175.000000
04-24 12:35:32 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 27.000000
04-24 12:35:32 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 4.000000
04-24 12:35:32 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35517.000000
04-24 12:35:32 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 99.000000
04-24 12:35:32 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_card
04-24 12:35:32 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 12:35:32 I/MeasurementPrinter:            99.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 12:35:32 E/TvtsBaseAssistantTest: Run 20/20 encountered exception. See logs for details
04-24 12:35:32 E/TvtsBaseAssistantTest: MoonTest failed: 
com.google.android.assistant.tvts.MoonTest:
Error in testMoonResponse(com.google.android.assistant.tvts.MoonTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)


Time: 65.258
There was 1 failure:
1) testMoonResponse(com.google.android.assistant.tvts.MoonTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/fragment_view_wrapper\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitHtmlContent(AssistantQueryTestBase.java:197)
	at com.google.android.assistant.tvts.MoonTest.testMoonResponse(MoonTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 12:35:32 D/RunUtil: Running command null without timeout.
04-24 12:35:32 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:35:33 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:35:33 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:35:33 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:35:34 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 12:35:34 D/RunUtil: Running command null without timeout.
04-24 12:35:34 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:35:34 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 12:35:34 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 12:35:34 D/RunUtil: Running command null without timeout.
04-24 12:35:34 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:35:34 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 12:35:34 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.katniss
04-24 12:35:34 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.katniss] with timeout: 2m 0s
04-24 12:35:35 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:35:35 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:35:35 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:35:35 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 12:35:35 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, getprop, ro.config.low_ram] with timeout: 45s
04-24 12:35:35 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, pm, list, features] with timeout: 2m 0s
04-24 12:35:35 W/TestDevice: Feature: feature:com.google.android.feature.AMATI_EXPERIENCE is not available on SKBFXYZO0C1V
04-24 12:35:35 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, getprop, ro.config.low_ram] with timeout: 45s
04-24 12:35:35 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, pm, list, features] with timeout: 2m 0s
04-24 12:35:36 W/TestDevice: Feature: feature:com.google.android.feature.AMATI_EXPERIENCE is not available on SKBFXYZO0C1V
04-24 12:35:36 I/BasicAggregationTypeBase: Checking if collection is initialized with data
04-24 12:35:36 I/BasicAggregationTypeBase: Checking if collection has invalid values
04-24 12:35:36 I/BasicAggregationTypeBase: Checking if collection is initialized with data
04-24 12:35:36 I/BasicAggregationTypeBase: Checking if collection has invalid values
04-24 12:35:36 I/BasicAggregationTypeBase: Checking if collection is initialized with data
04-24 12:35:36 I/BasicAggregationTypeBase: Checking if collection has invalid values
04-24 12:35:36 I/BasicAggregationTypeBase: Checking if collection is initialized with data
04-24 12:35:36 I/BasicAggregationTypeBase: Checking if collection has invalid values
04-24 12:35:36 D/PrettyTestEventLogger: 
==================== com.google.android.assistant.v4.tvts.TvtsAssistant4Test#testDistanceToTheMoon ENDED: Wed Apr 24 12:35:36 KST 2024 ====================
